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Abstract 


The  problem  of  estimating  signal  delay  in  signal-plus-noise  models  is 
considered.  A  technique  is  developed  for  approximating  likelihood  in  such 
a  way  that  a  dynamic  programming  algorithm  may  be  used  to  efficiently  and 
recursively  estimate  delay.  The  approximation  provides  an  alternative  to 
the  implementation  of  a  growing  bank  of  matched  filters  for  exhaustive 
maximization  of  likelihood.  Simulation  results  indicate  acceptable  per¬ 
formance  at  output  SNRs  in  excess  of  15  dB  for  deterministic  signals  and 
in  excess  of  20  dB  for  stochastic  signals. 


INTRODUCTION 


The  estimation  of  arrival  time  or  event  time  in  sonar  and  radar  applica¬ 
tions  is  such  a  commonly  encountered  problem  that  it  has  acquired  its  own 
acronym:  TDE  (for  time  delay  estimation) L  1 1 •  There  are  however  other 
applications  where  an  estimate  of  event  time  is  relevant.  These  include 
highway  traffic  control f  2^ and  fault  detection L 3] . 

Solutions  to  the  TDE  problem  vary  in  sophistication  from  threshold 
detection  as  used  by  Iyer[4  3,  to  tests  of  whiteness,  means  and  covariances 
employed  by  Mehra  and  PeschonC.53,  to  application  of  the  generalized  likeli¬ 
hood  ratio  by  Willsky  and  Jones[6l  .  Iyer  derives  a  threshold  detection 

algorithm  which  detects  the  rising  edge  of  satellite  broadened  laser  pulses. 

He  models  the  arrival  time  of  the  pulse  as  a  Poisson  process.  Based  on  this  he 

derives  the  probability  that  the  threshold  value  is  exceeded  at  some  time  j. 

He  then  maximizes  this  probability  with  respect  to  the  arrival  time  to 
obtain  the  detection  time. 

Mehra  and  Peschon  outline  an  innovations  approach  to  fault  detection. 

They  propose  hypothesis  tests  on  whiteness,  means,  and  covariances  of  the 
innovations  sequence  of  a  Kalman  predictor.  This  approach  is  applicable  in 
those  applications  which  allow  batch  or  fixed  lag  processing  of  the  observa¬ 
tions  . 

Wiilsky  and  Jones  use  a  generalized  likelihood  ratio  test  to  detect 
and  estimate  jumps  in  the  state  variables  in  autoregressive  moving  average 
(ARMA)  systems  driven  by  white  noise.  They  model  a  jump  in  the  state  of  the 
system  as  a  single  pulse  whose  amplitude  and  occurrence  time  are  unknown  para¬ 
meters.  They  note  that  implementation  of  their  algorithm  requires  a  growing 
bank  of  matched  filters.  This  is  due  to  the  fact  that  likelihood  must  be  com¬ 
puted  for  a  jump  occurrence  at  each  time  from  time  0  to  the  present.  They 
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suggest  an  approximation  in  which  likelihood  is  computed  only  for  the  current 
and  previous  M-l  occurrence  times. 

The  problem  of  growing  banks  of  filters  to  implement  TDE  algorithms  is 
common.  Another  method  that  is  often  used  to  avoid  this  problem  in  multi¬ 
sensor  applications  is  that  empolyed  by  KenneficC7l  .  He  uses  the  N  scan 
approximation  first  developed  by  Singer  et  al.L8Jto  efficiently  implement 
an  algorithm  which  generates  the  a-posteriori  density  function  of  a  Markov 
delay.  In  this  case  all  the  filters  with  an  identical  history  for  the  past 
N  steps  are  replaced  by  a  single  filter. 

In  this  paper  we  present  another  method  of  approximation  for  avoiding 
the  use  of  a  growing  bank  of  filters.  The  method  used  is  to  compute  the 
likelihood  of  delay  on  a  subset  of  the  interval  from  the  initial  time  to  the 
present.  The  subset  is  defined  recursively,  in  a  forward  dynamic  programming 
algorithm. 

The  TDE  algorithm  presented  here  is  dynamic  and  the  formalism  in  which 
we  present  it  is  much  the  same  as  that  normally  associated  with  dynamic  pro¬ 
gramming.  The  algorithm  does  not  yield  the  optimum  solution  to  the  TDE 
problem.  The  algorithm  is  however  recursive  in  nature,  and  storage  require¬ 
ments  are  constant  in  time.  There  is  no  need  for  a  growing  bank  of  filters. 


TIME  DELAY  ESTIMATION  IN  DETERMINISTIC  AND 
STOCHASTIC  SIGNAL  MODELS 


In  single  sensor  time  delay  estimation  problems,  we  are  interested  in 
estimating  the  arrival  time  of  a  signal.  The  signal  may  be  deterministic 
or  stochastic.  Here  we  introduce  an  observation  model  and  two  signal  models. 
We  give  several  equivalent  characterizations  of  the  TDE  problem  and  derive 
the  joint  distribution  of  the  observations  for  both  the  deterministic  and 
stochastic  signal  models. 


Observation  Model 

Consider  the  discrete-time  sequence  |  y  :  t  -  0,l,...,T-l|  .  A  noisy, 
delayed  version  of  the  sequence  is  observed: 


zt  ■  u^(d)  yt_j  +  n^  ,  t  «  0,1,..., T-l 

Here  d  is  the  delay  and  j  n^ :  t  «  0,1 . T-l}  is  a  sequence  of  independent 

identically  distributed  (iid)  normal  random  variables  with  mean  zero  and 
2  t-  ] 

variance  o^.  The  sequence  j  ut(d)}g  is  an  indicator  sequence: 

u  (d)  .  (°  0  <  '  <  i 

(  1  d  <  t  <  T-l 

The  indicator  sequence  characterizes  the  delay. 


Time  Delay  Estimation  Problem 

Let  I£  denote  the  discrete  set  It  -|0,1 . t+l},  and  let  Yfc  denote  the 

observations  to  time  t:  Y  «|y  }  .  Call  d  an  estimator  of  d  that  maps 

t  k  q  t 

observations  Y^  into  the  set  I 

t  t+l 


When  3^  ■  t+l,  we  say  the  delay  is  estimated  to  be  greater  than  t,  indicating 
that  the  observations  Y  are  noise  only.  Typically  we  construct  a  sequence 
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of  estimators  d  »  d, . d  that  terminates  at  time  t  *  T-l  in  an  estimate 

o'  r  t 

vs 

d^_j  based  on  the  complete  observation  set  Y^  j.  A  typical  sequence  would 
look  like  this: 


T-l 

0  12  3  4  5  6  7 


1  2  3  4  5  5  5  5 


vs 

In  this  case  we  would  say  d,j,_j  »  5.  Note  that  for  t  <  4,  the  data  is  judged  to 
be  purely  noise. 

With  this  formalism  we  may  give  three  equivalent  statements  of  the  time 
delay  estimation  problem:  given  the  observations  Yt» 

(1)  find  the  maximum  likelihood  estimate  of  d,  denoted  dt>  under 

A 

the  constraint  that  df  lie  in  It+j 

(2)  find  the  most  likely  indicator  sequence  |ufc(dt)|  C 

(3)  find  the  minimum  probability  of  error  test  of  vs.  vs.  ...vs. 

vs.  Ht  +  j,  with  denoting  the  hypothesis  that  d  *  k,  kel^^; 
the  understanding  is  that  d  •  t+I  corresponds  to  the  noise-only 
hypothesis . 

Here's  the  sense  of  the  equivalence.  Fix  t.  Let  ■  l/(t+l) 

denote  the  prior  distribution  over  the  H^.  As  the  sequence j  u^id^) ; 


k  -  1 


, 2, ... ,t |  maximizes  likelihood  it  follows  that  H£  is  the  choice  that 


minimizes  the  probability  of  error  in  selecting  an  hypothesis.  And,  as 
there  is  a  1:1  correspondence  between  d£  and  the  sequence  •|uk(dt.)|it 
follows  that  dt  is  also  the  maximum  likelihood  estimate  of  d  under  the 
constraint  that  dfc  lie  in  the  set  It+j* 


Deterministic  Signal 


sequence 


If  the  signal  sequence  7yi  is  known,  then  the  distribution  of  the  noisy 

n"No  *■ 
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max(d-l ,0) 


k«0  <2^)^  ««pj-^2  «^J  kLi„(d,t)  <2  TOn)Hi  • 

n 

exp|-  ^2  (zk _  uk(d)yk-d)2{ 

It  is  assumed  that  only  the  delay  parameter  d  is  unknown. 

Stochastic  Signal 

Many  physical  processes  may  be  effectively  modeled  as  stationary  autore¬ 
gressive  moving  average  (ARMA)  systems  driven  by  white  noise.  The  Markovian 
state  space  model  for  such  a  process  is 


6 


whereja^;  i  -  1,  2,  ...»  pj  and  jb^;  i  -  1,  2,  ....  p|  are  respectively 
the  AR  and  MA  coefficients  of  the  ARMA  model. 

The  innovations  representation  (see [^9 J  and  QlOj  for  descriptive 
accounts)  is  equivalent  to  the  Markovian  representation  in  the  sense  that 
output  means  and  correlation  sequences  are  the  same.  The  state  space 
equations  for  the  innovations  representation  are 


y  “  y  +  v 


yt  “  c  xt 


xt*i  ■  *  Ve 


Here  kf  is  a  Kalman  gain  vector ,|vt| 


T-l  . 


is  a  sequence  of  iid  normal  r. 


variables  with  mean  zero  and  variance  v  ,  and  y  is  the  one-step  Kalm 


prediction  based  on  yQ,  y^,...,  yf_j  .  The  Kalman  gain  satisfies  the  ations 


k  v  -  A[Q  -  Pic  +  a  h  h! 
t  t  L  o  tJ  w  1  1 


where 


r  -  c'P  c 
o  t 


P  ,  *  A  P  A'  +  k  k’v  :  P  -  0, 
t+1  t  t  t  t  o 


Q  -  AQ  A'  +  o  h.  h! 
xo  o  w  1  1 


The  matrix  Qq  is  the  steady-state  value  of  the  variance  matrix  P^  for  the 


state  vector  xt>  and  rQ  is  the  zero-lag  value  of  the  correlation  sequence  for 
the  process  |  y  |  : 


c'  AQ  A '  c  +  o  c'h.h'  c 
o  w  1  1 


The  only  difference  between  the  innovations  model  for  the  signal  sequence 
{  y  }  and  the  innovations  model  for  the  noisy  sequence  {ztf»  with  zf  ■  y  +  nc, 
is  in  the  specification  of  initial  conditions  on  r  : 


With  this  representation  we  may  write  the  joint  density  function  of  the 
observations  <  z,  > 

t  kl  0 


as 


max(d- 1 ,0) 

n 

k=0 


(27ia2T^exp^- 
n 


i  k 


n 

k*min(d,t) 


(2TTvk_d)"^  exp 


l' 


(zk-  uk(d)  yk(d))- 


Here  y,  (d)  is  the  Kalman  prediction  of  y,  ,  given  that  (really,  assumed  that) 
k  K 

1 

the  ARMA  sequence  has  arrived  time  d  <  k: 

yR(d)  -  c’xk(d) 

xk»i(d)  ■  Axk<d)  *  kk-d  Vd> 

Vd)  *  *k  -  >ik<d) 

xk(d)  *  0,  k  <  d 

Of  course  kf  follows  the  recursion  previously  given. 


This  brings  up  a  curious  question:  does  it  make  sense  to  speak  of  time 
delay  estimation  in  stationary  models?  In  such  models  the  notion  of  a 
time  origin  is  irrelevant.  It  is,  however,  possible  to  imagine  a 
stationary  field  which  is  fully  developed  (i.e.  stationary),  but 
is  only  switched  into  the  environment  at  time  d.  This  is  the  case  we 
are  considering. 
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EXACT  AND  APPROXIMATE  LIKELIHOOD  AND  DYNAMIC  PROGRAMMING 


We  now  introduce  a  two  state  machine  representation  of  the  TDE  problem. 
We  then  derive  the  log  likelihood  functions  which  must  be  maximized  to 
obtain  the  estimate  of  the  indicator  sequence.  Exact  computation  of  the 
likelihood  function  is  shown  to  be  computationally  unattractive  because  it 
involves  computation  of  the  likelihood  for  each  d  in  the  set  It+|*  As  an 
alternative  we  compute  approximate  likelihood  on  a  subset  of  which  we 


denote  I  , . 

t+  1 

Log  Likelihood 

In  the  deterministic  case 
observations  / z  >  is 

l  Mo 


the 


log-likelihood 


function  for  d,  based  on 


lt(d) 


log 


(2™2)-(t+1)/2 

n 


t 

Z 

k-0 


(z, 


u  .(d) 
k 


2 


In  the  stochastic  case  the  log-likelihood  is 


8.  (d)  «  Z  log  f(2u(o2  +  u  (d)(v  (d)-o2)\ 
t  k-1  V  n  k  k  n  J 

t  (zk-uk(d)^(d))2 

k“'  2(a2  +  u,  (d)(v.  (d)-o2)  ) 

n  k  k  n 

Note  that  in  both  cases  we  may  define  the  log-likelihood  in  a  recursive 
fashion: 

£t(d)  ■  +  Pt(d) 

The  term  p^Cd)  is  called  the  path  metric. 

Because  of  the  nature  of  the  indicator  sequence  it  is  clear  that  for 
both  the  deterministic  and  stochastic  signal  models  the  log-likelihood  must 
be  evaluated  for  two  separate  regions:  k  <  d  and  k  >  d. 


This  observation  suggests  a  two  state  machine  representation  of  the  TDE 
problem. 

The  Two  State  Structure  of  the  TDE  Prob  .-1 

Let  0  and  1  denote  the  states  of  the  two  state  machine.  See  Figure  1. 
Associate  the  indicator  sequence  with  a  sequence  of  visits  to  these  states. 
For  k  <  d  state  0  is  visited.  For  k  >  d  state  1  is  visited.  An  example 
for  t  *  8  and  d  *  4  is  illustrated  on  a  two  state  trellis  in  Figure  2. 

Note  that  transitions  from  state  1  to  state  0  are  forbidden  because  once 
the  indicator  is  on  it  stays  on  (i.e.,  the  signal  persists).  Thus  the 
TDE  problem  is  that  of  estimating  the  time  when  the  transition  from 
state  0  to  state  I  occurs. 

Exact  Likelihood 

At  each  time  interval  associate  the  log-likelihood  S, t ( d>C )  with  state  0. 
£,t(d>t)  is  the  likelihood  that  d  is  greater  than  t.  Likewise,  associate  with 
state  1  the  log-likelihood  function  £t(d<t). 

The  computation  of  £t(d>t)  is  easy.  It  is  dependent  only  on  its  most 
recent  value  and  the  path  metric  pt(d>t)  where 

p  (d>t)  -  log (  -1—f - \ -  (z  )2  . 

V  2 to2/  2o„  C 

n  n 

The  log-likelihood  corresponding  to  state  1  is  more  complex.  jl^Cdct) 
must  be  evaluated  for  every  d  in  I^.  This  means  that  computation  of  the 
exact  likelihood  Jl^Cd)  requires  a  bank  of  t  +  2  filters:  (t  +  1)  filters 
to  compute  £t(d<t)  for  d  *  0,1,..., t,  and  one  filter  to  compute  £t(d>t). 

We  compute  £t<d)  for  d<t  as 

£t(d)  *  j (d)  +  pt (d ) 

where 
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TATE  MACHINE. 
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FIGURE  2 


3  4  5  6  7 


.  TWO  STATE  TRELLIS. 
d  =  4,  t  =  8 


1 


p  (d)  -  log 


(dr)' 


2a 


(2t  "  yt-dV 


in  the  deterministic  case  and 


/  \-^  (Zt'Md))2 

p .(d)  -  log  (  2ttv  (d ) j  *  -  \  c  c — d- 

t  \  )  2vt(d) 

✓v 

for  the  stochastic  signal  model.  Here  y£(d)  is  obtained  from  a  one  step 
Kalman  predictor  initialized  at  time  d.  For  the  case  d  -  t,  we  compute 


£t(d)  as 


£t(d«t)  -  £t_j(d>t-l)  ♦  p  (d-t) 

where  the  path  metric  depends  on  which  signal  model  is  being  used.  Having 


computed  the  likelihood,  £^(d),  the  delay  estimate  is  chosen  as 


!t  *  arg  max  ^t(d>t),  SL^ 


(d-0),  Ht(d-1), 


M,t)]l 


It  is  clear  that,  for  long  data  records,  computing  the  likelihood  Jl^Cd) 
becomes  burdensome  and  impractical.  We  offer  an  alternative  approach,  first 
introduced  in]j  1 J. 


Approximate  Maximum  Likelihood 

In  order  to  avoid  the  computational  problems  of  simultaneously  running 
a  growing  bank  of  filters  we  compute  the  likelihood  associated  with  state 

A 

1  on  a  subset  of  I  j  which  we  denote  I  .  The  result  is  that  the  number  of 
filters  required  at  any  time  interval  is  reduced  to  3. 

A 

Let  us  examine  how  the  subset,  It+j*  is  defined.  Fix  t  at  2.  At  time 

2  for  state  1  we  must  consider  two  possibilities:  the  signal  is  just  arriving 
which  implies 


Sl2(d-2)  -  8,  j  (d>  1 )  +  p2(d-2); 
or  the  signal  arrived  at  time  1  which  implies 
Jl2(d<2)  -  Hj(d<  1)  ♦  p2(d-I) 
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Thus  we  choose 


fi-2 ( d<2 )  -  max[2,j(d>l)  +  p2(d-2),  fl, j (d<  1 )  +  p2(d«l)]]  • 

If  2j(d>l)  +  p2(d«2)  is  chosen,  then  at  t  -  3,  we  ignore  the  possibility  that 
the  signal  arrived  at  time  I,  and  do  not  compute  the  likelihood  for  d*l. 

If  £,  j  (d<  1 )  +  p2 ( d*  1 )  is  chosen  at  t  ■  2,  then  at  t  ■  3  we  ignore  likelihood 
for  d  ■  2.  In  general  the  likelihood  associated  with  state  1  is  computed  as 

8,t(d<t)  =  max[jlt_1(d>t-l )  +  pt<d-t),  ^t_j(d<t-l)  +  p  (d*dt_j)]] 

where  d£  is  a  running  time  variable  defined  as 

t  Ht_ j(d>t-l)  +  pt(d=t)  >  S-t_](d<t-l)  +  Pt(d=dt_i) 
dt_]»  2t_j(d<t-l)  +  Pt(d=dt_j)  >S.t_](d>t-l)  +  pt(d=t) 

Thus  at  any  time  interval  we  calculate  the  likelihood  of  only  three  of  t  +  2 

A 

possible  delays  in  the  set  It+]*  The  variable  dt  recursively  defines  It+1» 
the  subset  of  1^  on  which  we  compute  likelihood.  At  any  time  t  we  may 
terminate  the  procedure  and  compute  the  final  delay  estimate  by 

t+1,  £t(d>t)  >  S,t(d<t) 
dt>  (d<t )  >  S,t(d>t) 

Figure  3  illustrates  log-likelihoods  computed  on  the  set  1^  and  likelihoods 

/\ 

computed  on  the  set  It+j»  f°r  t  ■  7.  In  the  example  illustrated,  no  error 
would  have  been  made  by  discarding  likelihoods  2y(0),  2^(1),  2^(2),  27(4), 
2^(5) ,  and  2^(6),  and  saving  only  2^(4),  2^(7),  and  2^(8).  Such  is  not  always 
the  case. 

A  Note  on  the  Implementation  of  the  TDE  Algorithm 

The  general  algorithm  is  summarized  in  Table  1.  It  requires  the 
implementation  of  three  filters  at  each  time  interval.  Filter  I  computes 


CL> 


Compute  Path  Metrics 
Pt(d-t)  pt^d"dt-l?  Pt(d>t) 


Compute  Log-Likelihoods 
tt(d>t)  -  tt_1(d>t-l)  +  pt(d>t) 

<-t (d<_t)  -  max  [tt_1(d>t-l)  +pt(d-t), 

+  Pt(d-dt_1)] 


Decision 

t,  it_1(d>t-i)+pt(d-t)  >  tt_1(d<t-i)-fr>t(d-dt_1) 
dt-l*  1t-1(d>t'1)+Pt(d"t)  -  tt-l(d-~1)+Pt(d“dt-l) 


t 


t+1  ,  £t(d>t)  >  *t(d<t) 
dt  »  1t(d>t)  <  ^t(d<t) 


Storage 

Initial  Conditions 

dt 

!Q(d>0)  -  0 

£t(d>t) 

£0(d<0)  -  0 

tt(d<t) 

o. 

o 

■ 

o 

Table  I:  Summary  of  TDE  Algorithm 
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JLt(d>t),  Filter  2  computes  SL t_ j (d>t—  1 )  +  Pt(d«t),  and  Filter  3  computes 
| <d<t- 1 )  +  Pt(d-dt_j). 

For  the  deterministic  signal  models  these  filters  are  straightforward 
and  require  no  comment. 

For  the  stochastic  signal  however  filter  2  and  filter  3  require  as 
part  of  their  structure  the  Kalman  predictor. 

Let  us  examine  the  use  of  the  Kalman  predictor  within  the  structure 
of  the  TDE  algorithm.  The  Kalman  predictor  associated  with  filter  2  is 
reset  to  initial  conditions  at  each  time  interval  in  order  to  compute  the 
path  metric  pt(d**t).  The  predictor  in  filter  3  was  initialized  at  time 
dt_j  and  has  been  running  since  to  give  the  path  metric  Pt(d*dt  j). 

If  the  decision  d^t  is  made  then  we  have  to  reinitialize  filter  3  to 
compute  the  next  path  metric  p£+ j(d-dt*t ) .  Rather  than  doing  this,  we  can 
take  advantage  of  the  fact  that  filter  2  has  already  computed  the  gain 
kQ,  a°d  the  error  variance  v^.  By  transferring  these  variables  from  filter 
2  to  filter  3  we  save  the  time  required  to  compute  the  Kalman  gain  vector. 
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EXPERIMENTAL  RESULTS 


The  thesis  of  GSF  £_12j  contains  simulated  examples  that  show  how  the 
trellis  evolves  and  how  It+j»  dt>  and  £t(d)  are  computed  for  individual 
data  realizations.  The  examples  are  instructive.  Here  we  present  only 
results  of  Monte  Carlo  tests 

For  the  deterministic  signal  model  we  have  defined  the  SNR  as 


SNR  ■ 


N 

E 

t-0 


where  N  *  T-d  is  the  number  of  samples  of  the  signal  in  the  observation  inter¬ 
val.  The  signal  model  is  simply  y  »  ut  (the  unit  step  sequence). 

To  demonstrate  algorithm  performance  when  the  underlying  signal  may  be 
modeled  as  an  ARMA  structure  driven  by  white  noise,  anARMA  (3,2)  model  was 


chosen.  The  z-transfer  function  of  the  system  is 


m  1  -  1.750z  *  +  . 800z  2 _ 

1  -  1.500z”1  +  1.210z-2  -  ,455z 
For  the  stochastic  signal  we  have  defined  the  SNR  as 

SNR  -  10  log  j  0 

where  N  is  the  number  of  samples  of  the  signal  in  the  observation  interval: 

N  -  T-d. 

The  Monte  Carlo  tests  consisted  of  running  the  algorithm  1000  times. 

Each  time  the  delay  was  fixed  at  14  and  the  length  of  the  simulation  was  30 
(t  -  0,1,...,  29).  The  final  delay  estimate  from  each  simulation  is  stored. 
These  results  are  then  averaged  to  compute  the  sample  statistics  of  the  delay 
estimator. 
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A  typical  relative  frequency  of  delay  estimates  is  illustrated  in 
Figure  4.  The  signal  is  a  unit  pulse  sequence  and  the  output  SNR  is  >5  db. 

Table  2  summarizes  the  results  of  the  Monte  Carlo  tests  for  the 
deterministic  signal  model.  Figure  5  is  a  plot  of  the  MSE  vs.  SNR  obtained 
from  the  Monte  Carlo  tests  using  the  deterministic  unit  pulse  sequence. 

Figure  6  shows  relative  frequency  of  delay  estimates  for  the  stochastic  case 
when  output  SNR  »  21.7.  Table  3  summarizes  the  results  of  the  Monte  Carlo 
tests  using  the  stochastic  signal  model.  Figure  7  is  a  plot  of  the  MSE  vs.  SNR 
for  the  stochastic  signal  model.  Figure  8  is  a  plot  of  the  miss  probability 
vs.  SNR  for  both  the  deterministic  and  stochastic  model.  The  miss  probability 
is  defined  to  be  the  probability  that  the  delay  is  estimated  to  be  greater 
than  or  equal  to  T-l,  when  in  fact  the  signal  was  present  at  delay  d<T-l  (in 
this  case  d»14). 

The  use  of  "soft"  decision  would  offer  an  attractive  method  for  improving 
the  algorithm  performance.  At  present  each  time  the  decision  d£  ■  t  is  made 
we  reinitialize  the  filter  associated  with  state  1  and  eliminate  past  values 
of  d  from  consideration.  Instead,  if  the  decision  d£  ■  k  is  made  and  this 
value  persists  for  n  steps,  then  a  filter  should  be  maintained  for  computing 
dt(d»k).  This  increases  the  size  of  the  subset  of  I£+j  on  which  we  compute 
fl. t (d ) .  The  value  of  n  is  chosen  to  get  a  reasonable  trade  off  between  compu¬ 
tation  time  and  estimation  accuracy. 


MSC/T 


Unit  Pulse 

SNR 

MSE 

Bias 

20 

1.65 

.02 

17 

2.44 

.04 

15 

4.82 

.07 

12 

18.12 

.29 

10 

22.74 

.38 

6 

46.15 

.89 

Table  2.  Summary  of  Monte  Carlo  Tests  for  the  Unit 
Pulse  and  Modulated  Pulse  Signals 


Figure  5. 


SNRCdb  ) 

MSE/T  vs.  SNR  for  Unit  Pulse  Signal 


MSE/  T 
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